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Abstract 

We consider the following distributed consensus problem: Each node in a complete 
communication network of size n initially holds an opinion, which is chosen arbitrarily from 
a finite set E. The system must converge toward a consensus state in which all, or almost 
all nodes, hold the same opinion. Moreover, this opinion should be valid, i.e., it should be 
one among those initially present in the system. This condition should be met even in the 
presence of an adaptive, malicious adversary who can modify the opinions of a bounded 
number of nodes in every round. 

We consider the 3-majority dynamics: At every round, every node pulls the opinion 
from three random neighbors and sets his new opinion to the majority one (ties are broken 
arbitrarily). Let k be the number of valid opinions. We show that, ii k ^ n°‘, where a is a 
suitable positive constant, the 3-majority dynamics converges in time polynomial in k and 
logn with high probability even in the presence of an adversary who can affect up to o(i/n) 
nodes at each round. 

Previously, the convergence of the 3-majority protocol was known for |E| =2 only, 
with an argument that is robust to adversarial errors. On the other hand, no anonymous, 
uniform-gossip protocol that is robust to adversarial errors was known for |E| > 2. 

Keywords: Distributed Consensus, Byzantine Agreement, Gossip Model, Majority Rules, 
Markov Chains. 


1 Introduction 


We study the following probabilistic, synchronous process on a complete network of n anony¬ 
mous nodes; At the beginning, each node holds an “opinion” which is an element of an arbitrary 
finite set S. We call an opinion valid if it is held by at least one node at the beginning. Then, 
in each round, the following happens: 1) every node pulls the opinion from three random nodes 
and sets its new opinion to the majority one (ties are broken arbitrarily), and 2) an adaptive 
dynamic adversary can arbitrarily change the opinions of some nodes. We consider F-dynamic 
adversaries that, at every round, can change the opinions of up to F nodes, possibly introducing 
non-valid opinions. 

Let the system start from any configuration having k valid opinions with k ^ n°‘ for some 
constant a < 1 and consider any T-dynamic adversary with F = logn)). We prove 

that the process converges to a configuration in which all but Oiy^fn) nodes hold the same valid 
opinion within 0{{k‘^y/\ogn+k log n){k-\-log n)) rounds, with high probability. So, this bounded 
adversary has no relevant chances to force the system to converge to non-valid opinions. 

This shows that the 3-majority dynamics provides an efficient solution to the stabilizing- 
consensus problem in the uniform-gossip model. Previously, this was known only for the binary 
case, i.e. |S| =2, while for any |S| ^ 3, it has been an important open question for several years 
mm- Furthermore, still for any |S| ^ 3, o(n)-time convergence of the 3-majority dynamics 
was open even in the absence of an adversary whenever the initial bias toward some plurality 
opinion is not large. 

In the reminder of this section, we will describe in more detail the consensus problem and 
various network scenarios in which it is of interest, our result in this setting, and a comparison 
with previous related results. 

1.1 Consensus (or Byzantine agreement) 

The consensus problem in a distributed network is defined as follows: A collection of agents, 
each holding a piece of information (an element of a set S), interact with the goal of agreeing 
on one of the elements of S initially held by at least one agent, possibly in the presence of 
an adversary that is trying to disrupt the protocol. The consensus problem in the presence 
of an adversary (known as Byzantine agreement) is a fundamental primitive in the design of 
distributed algorithms |22l I24j . The goal is to design a distributed, local protocol that brings 
the system into a configuration that meets the following conditions: (1) Agreement. All non- 
corrupted nodes support the same opinion u; (2) Validity: The opinion v must be a valid 
one, i.e., an opinion which was initially declared by at least one (non-corrupted) node; (3) 
Termination: Every non-corrupted node can correctly decide to stop running the protocol at 
some round. 

Recently, there has been considerable interest in the design of consensus algorithms in models 
that severely restrict both communication and computation 131E1II2], both for efficiency consid¬ 
eration and because such models capture aspects of the way consensus is reached in social net¬ 
works, biological systems, and other domains of interest in network science mmmummm- 

In particular, we assume an anonymous network in which nodes possess no unique IDs, nor 
do they have any static binding of their local link ports (i.e., nodes cannot keep track of who sent 
what). From the point of view of computation, the most restrictive setting is to assume that 
each node only has 0(log |i;|) bits of memory available, i.e., it just suffices to store a constant 
number of opinions. We further assume that this bound extends to link bandwidth available in 
each round. Finally, communication capabilities are severely constrained and non-deterministic: 
Every node can communicate with at most a (small) constant number of random neighbors in 
each round. These constraints are well-captured by the uniform-gossip communication model 
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[ini [ISl [H]: At every round, every node can exchange a (short) message (say, 0(log(j^E|)) 
bits) with each of at most h random neighbors, where /i is a (small) absolute constanllJ. A 
more recent, sequential variant of the uniform-gossip model is the (random) population-protocols 
model BW in which, in each round, a single interaction between a pair of randomly selected 
nodes occurs. 

The classic notion of consensus is too strong and unrealistic in the aforementioned distributed 
settings, that instead rely on weaker forms of consensus, deeply investigated in [a n El iig. 
In this paper, we consider a variant of the stabilizing-consensus problem [3] considered in [3]: 
There, a solution is required to converge to a stable regime in which the above three properties 
are guaranteed in a relaxed, still useful formH. More precisely: 

Definition 1.1. A stabilizing almost-consensus protocol must ensure the following properties: 

- Almost agreement. Starting from any initial configuration, in a finite number of rounds, the 
system must reach a regime of configurations where all but a negligible “bad” subset (i.e. having 
size 0{n'^) for constant j < 1) of the nodes support the same opinion. 

- Almost validity. The system is required to converge w.h.p. to an almost-agreement regime 
where all but a negligible bad set of nodes keep the same valid opinion. 

- Non termination. In dynamic distributed systems, nodes represent simple and anonymous 
computing units which are not necessarily able to detect any global property. 

- Stability. The convergence toward such a weaker form of agreement is only guaranteed to 
hold with high probability (in short, w.h.pHj and only over a long period (i.e. for any 
arbitrarily-large polynomial number of rounds). 

The main result of this paper is on the convergence properties of the 3-majority dynamics 
in the uniform-gossip model in the presence of the adaptive T-dynamic adversary (defined 
above) and of the adaptive F-static adversary. In the latter, the adversary looks at the initial 
configuration, then changes the opinion of up to F nodes and, after that, no further adversary’s 
actions are allowed. 

Theorem 1.2. Let k for some constant a < 1 and F = (3^/n/{k^ logn) for some constant 
/3 > 0. Starting from any initial configuration having k valid opinions, the 3-majority dynamics 
reaches a (valid) stabilizing almost-consensus in presence of any F-dynamic adversary within 
C)((A:^v^Iog7i-|-A:logn)(/c-|-logn)) rounds, w.h.p. 

Moreover, the same bound on the convergence time holds in the presence of any F-static adver¬ 
sary with a larger bound on F, i.e., F = n/k — y/kn logn. 

In [7], an Il(fclogn) bound on the convergence-time of the 3-majority dynamics is derived 
(that holds even when the system starts from biased configurations): So, our bound is almost- 
tight whenever k = 0(polylog(n)). 

Not assuming a large initial bias of the plurality opinion considerably complicates the analy¬ 
sis. Indeed, the major open challenge is the analysis from (almost) uniform configurations, where 
the system needs to break the initial symmetry in the absence of significant drifts towards any 
of the initial opinions. So far, this issue has never been analyzed even in the non-adversarial 
case. Moreover, the phase before symmetry breaking is the one in which the adversary has 
more chances to cause undesired behaviours: Long delays and/or convergence towards non- 
valid opinions. In Section [2l after providing some preliminaries, we shall discuss the above 
technical challenges. 

^In fact, h — 1 vci the standard uniform-gossip model. It is easy to verify that all our results still hold in this 
more restricted model at the cost of a constant slow-down in convergence time and local memory size. 

^ These relaxed convergence properties are described in detail in Section 7 of [3]. 

^According to the standard definition, we say that a sequence of events £„, n = 1,2,... holds with high 
probability if P (En) = 1 — 0{l/n^) for some positive constant A > 0. 
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1.2 Previous results 


Consensus problems in distributed systems have been the focus of a large body of work in 
several research areas, such as distributed computing m, communication networks [25], social 
networks and voting systems [ZD HZ], distributed databases [TO] ED, biological systems and 
Chemical Reaction Networks [9]. For brevity’s sake, we here focus on results that are closest in 
spirit to our work. 

In [3], the authors show that w.h.p. n agents that meet at random can reach valid stabilizing 
almost-consensus in O(nlogn) pairwise interactions against an F = o(y^)-bounded dynamic 
adversary. The adopted protocol is the well-studied third-state protocol [3 HD- However, their 
analysis (and, thus, their result) only holds for the binary case and for the population-protocol 
model: At every round only one pair of nodes can interact. The authors left the existence of 
protocols for the multi-valued Byzantine case as a final open question [3] . In general, sequential 
processes are much easier to analyze than parallel ones (like those yielded by the uniform-gossip 
model): For instance, the resulting Markov chains are reversible [23 while those arising from 
parallel processes are non-reversible. 

In the uniform-gossip model, in [12] the authors provide an analysis of the 3-median rule, in 
which every node updates its value to the median of its random sample. They show that this 
dynamics converges to an almost-agreement configuration (which is even a good approximation 
of the global median) within 0(log k ■ log log n -\- log n) rounds, w.h.p. It turns out that, in the 
binary case, the median rule is equivalent to the 3-majority dynamics, thus their result implies 
that 3-majority is an {F = yTij-stabilizing consensus with O(logn) convergence time. However, 
in the non-binary case, it requires S to be a totally-ordered set and the possibility to perform 
basic algebraic operations: This is a rather strong restriction in applications arising from social 
networks, voting-systems, and bio-inspired systems. More importantly, we emphasize that, 
even assuming an ordered opinion set (S, ^), the 3-median rule does not guarantee the crucial 
property of validity against both T-static (and, clearly, dynamic) adversaries even for very-small 
bounds on F (say F = polylog(n)). 

We strongly believe that the validity property of consensus plays a crucial role in several 
realistic scenarios, such as monitoring sensor networks, bio-inspired dynamic systems, and voting 
systems [HIEDIZD. 

More recently, the 3-majority rule in the multi-opinion case (i.e. for |S| ^ 3) has been 
studied for a stronger goal than consensus, namely, stabilizing plurality consensus [D- In this 
task, the goal is to reach an almost-stable consensus towards the valid opinion initially supported 
by the plurality of the nodes. However, the initial configuration is assumed to have a large bias 
towards the pluraltiy opinion. Then, let k be the number of valid opinions, and let s be the 
initial difference between the largest and the second-largest opinion: By strongly exploiting the 
assumption s ^ y/kn logn, the authors in [D proved that, w.h.p., the system converges to the 
plurality opinion within time 0(A:logn). 

Another version of binary stabilizing almost-consensus is the one studied by Yildiz et al in 
m- Here, corrupted nodes are stubborn agents of a social network who influence others but 
never change their opinions. They prove negative results under a generalized variant of the 
classic voter dynamics in the (Poisson-clock) population-protocol model. 

2 The Process and its Analysis in a Nuthshell 

Preliminaries. We assume a distributed system consisting of n nodes that communicate with 
each other over a complete graph via the synchronous uniform-gossip mechanism: In every 
round, each node can pull information from (at most) h random neighbors, where h is an 
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absolute constant (in this work, h = 3). At the onset, every node chooses an arbitrary item, 
called opinion, from an arbitrary finite set S. A simple dynamics for consensus is the 3-majority 
protocol [7]: 

In each round, every node samples three nodes uniformly at random (including itself 
and with repetitions) and revises its opinion according to the majority of the opinions 
it sees. If it sees three different opinions, it picks the first one. 


Clearly, in the case of three different opinions, choosing the second or the third one would not 
make any difference, nor would choosing one of the observed opinions uniformly at random. 

Since the communication graph is complete and nodes are anonymous, the overall system 
state at any round can be described by a configuration c := (ci, ...,C|s|), where the support Ci 
of opinion i is the number of nodes holding opinion i in that system’s state. Given configuration 
c, we say that an opinion i is active in c if Cj > 0 and, for any set of active opinions W f T,, 
we define m(VC) := axg mmi^w Ci. For any variable x of the process, we write if we 
are considering its value at round t and to denote the corresponding random variable. 
Furthermore, following [2U] . considered a configuration c and a random variable X defined over 
the process, we write Pc = x) for P (XW = X I i-®-! to denote the probability 

distribution of the variable X when the system evolves for t consecutive rounds starting from 
configuration c. Analogously, we write Ec for the associated conditional expectation. 


The next lemma provides the expected number of nodes supporting a given opinion at round 
t + 1 (and a general upper bound to it), given the configuration at round t. The simple proof of 
the first equality is in [7]. It is also included in Appendix to make the paper self-contained. 

Lemma 2.1 (See [7]). Let c be the configuration at round t and let W C S he the subset of 
active opinions in c. Then, for any opinion i € W, 


E 




(t+i) 



E 


jew 





^ Ci 




( 1 ) 


The above upper bound easily implies that opinions whose supports fall below the average 
n/|VF| decrease in expectation. This expected drift is a key-ingredient of our analysis and, 
as we will see in the next paragraph, it provides useful intuitions about the process. On the 
other hand, when c is almost uniform, the above drift turns out to be negligible and symmetry 
breaking is due to the inherent variance of the random process. 

Failed attempts. When the 3-majority dynamics starts from configurations that exhibit a 
large initial support bias between the largest and the second-largest opinions, the approach 
adopted in [7j successfully exploits the fact that the initial plurality is preserved throughout 
the evolution of the random process, with an expected positive drift that is also preserved, 
w.h.p. An intuition of this fact can be achieved from simple manipulations of ([T]). However, the 
aforementioned drift is only preserved if the largest opinion never changes (w.h.p.), no matter 
which the second-largest opinion is: a condition that is not met by uniform configurations. A 
promising attempt to cope with uniform configurations is to consider the r.v. — 

"'^here M(t) and 2M(f) are the r.v.s that take the index of (one of) the largest opinion 
and of (one of) the second-largest ones, respectively, in round t. For any fixed pair i,j, such 
that Ci > Cj, ([I]) implies that the difference in the next round is positive in 

expectation, so a suitable submartingale argument [20] seemed to work in order to show that 
the system (rather quickly) achieves a “sufRciently-large” bias toward the plurality as to allow 
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fast convergence. This approach would work if the random indices M and 2M maintained their 
initial values across the entire duration of the process. Unfortunately, starting from uniform 
configurations, in the next round, the expected difference between the new largest opinion and 
the new second largest one may have no positive drift at all. Roughly speaking, in the next 
round, the r.v. C'^Mh+i) much larger than the r.v. 

A promising dynamics for the stabilizing almost-consensus problem is the one introduced in 
[12| . in which nodes revise their opinions (assumed to be totally ordered) by taking the median 
between the currently held opinion and those held by two randomly sampled nodes. However, 
while we do not assume opinions to be integers (or totally ordered), their analysis strongly 
relies on the fact that the median opinion (or any good approximation of it) exhibits a strong 
increasing drift, even when starting from almost-uniform configuration, whereas no opinion is 
“special” to a majority rule when the starting configuration is uniform. The adoption of an 
inherently biased function as the median can have important consequences. To get an intuition, 
the reader may consider the following simple instance: S = {1,2,3}, with the system starting 
in configuration ci = n/2,C2 = 0, C3 = n/2. At the end of the first round, a static adversary 
changes the values of F = logn nodes, equally distributed in ci and C3, to value 2. The (non- 
valid) value 2 is the global median and some counting arguments show that, while values 1 and 2 
have no positive expected drift, the median has an exponential expected drift that holds w.h.p. 
whenever ci,C 2 = 0(n). This might fool the system into the configuration in which C 2 = n, 
thus converging to a non-valid value. 

Our New Approach: An Overview. Our analysis significantly departs from the above 
approaches. It is important to remark that, for |S| ^ 3, no analysis of the 3-majority dynamics 
with almost-uniform initial configurations is known, even in the simpler non-adversarial case. 
On the other hand, while simpler, the analysis of the non-adversarial case still has perse interest 
and it requires to address some of the main technical challenges that also arise in the adversarial 
case. Section [3] will be thus devoted to the analysis of the non-adversarial case, while an outline 
is given in the paragraphs that follow. 

When the configuration is (approximately) uniform, Lemma 12.11 says us that the process 
exhibits no significant drift toward any fixed opinion. Interestingly, things change if we consider 
the random variable , indicating the smallest opinion support at round t. Let j ^ fc be 
the number of active opinions in a given round t, we first prove that the expected value of Cm 
always exhibits a non-negligible negative drift: 


E 






for some constant e > 0 


( 2 ) 


This drift is essentially a consequence of Lemma 12.11 and of the standard deviation of r.v.s 
Cj^^^s (see the proof of Lemma 13.31) . The analysis then proceeds along consecutive phases, each 
consisting of a suitable number of consecutive rounds. If the number of active opinions at 
the beginning of the generic phase is j, we prove that, with positive constant probability. Cm 
vanishes within the end of the phase, so that the next phase begins with (at most) j — 1 active 
opinions. 

We clearly need a good bound on the length of a phase beginning with at most j opinions. To 
this aim, we derive a new upper bound - stated in Lemma 13.21 - on the hitting time of stochastic 
processes with expected drift that are defined by finite-state Markov chains [20]. Thanks to this 
result, we can use the negative drift in ([2]) to prove that, from any configuration with j ^ k 
active opinions. Cm drops below the threshold n/j — y/jnlogn within C(poly(},logn)) rounds, 
with constant positive probability: This “hitting” event represents the exit condition from the 
symmetry-breaking stage of the phase. Indeed, once it occurs, we can consider any fixed active 
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opinion i having support size Cj below the above threshold (thanks to the previous stage, we 
know that there is a good chance this opinion exists): We then show that Ci has a negative 
drift of order Q{ci/j). This allows us to prove that Ci drops from n/j — ^/jnTogn to zero within 
0(poly(j, log n)) further rounds, with positive constant probability. This interval of rounds is 
the dropping stage of the phase. 

Ideally, the process proceeds along k consecutive phases, indexed as j = k, k — 1,... ,2, such 
that we are left with at most j — 1 active opinions at the end of Phase j. In practice, we 
only have a constant probability that at least one opinion disappears during Phase j. However, 
using standard probabilistic arguments, we can prove that, w.h.p., for every j, the transition 
from j to J — 1 active opinions takes a constant (amortized) number of phases, each requiring 
0(poly(j, log n)) rounds. 

The presence of a dynamic, adaptive adversary makes the above analysis technically more 
complex. A major issue is that a different definition of Phase must be considered, since the 
adversary might permanently feed any opinion so that the latter never dies. So the number of 
active opinions might not decrease from one phase to the next one. Essentially, we need to man¬ 
age the persistence of “small” (valid or not) opinions: The end of a phase is now characterized 
by one “big” valid color that becomes “small” and, moreover, we need to show that, in general, 
“small” colors never becomes “big”, no matter what the dynamic E-bounded adversary does. 
An informal description of the dynamic-adversary case is given in Subsection 14.21 

3 The 3-Majority Dynamics without Adversary 

Let C C S be the subset of valid opinions, i.e. those supported by at least one node in the 
initial configuration, and denote by A: = |C| its size. This section is devoted to the proof of the 
following result. 

Theorem 3.1 (The Adversary-Free Case.). Starting from any initial configuration with k ^ 
j.ji/3-e active opinions, where e > 0 is an arbitrarily-small constant, the 3-majority dynamics 
reaches consensus within O ^(/c^ log^^^ n -|- klogn){k -|- logn)^ rounds, w.h.p. 

We first provide the lemmas required for the process analysis and then we give the formal proof 
of the above theorem. 

The next lemma shows an upper bound on the time it takes a stochastic process with values 
m N = {0, 1,..., n} to reach or exceed a target value m, under mild hypotheses on the process. 
We here give only an idea of the proof, the full proof is in Appendix O 

Lemma 3.2. Let {Xt}t be a Markov chain with finite state space Ll, let f : LI ^ N be a 
function mapping states of the chain in non-negative integer numbers, and let {Yt}t be the 
stochastic process over N defined by Yf = f{Xt). Let m € N be a “target value” and let 

T = inf{t G N : If ^ m} 

he the random variable indicating the first time Yt reaches or exceeds value m. Assume that, for 
every state x € LI with f{x) ^ m — 1, it holds that 

1. (Positive drift). E [If+i \Xt = x]fi f{x) -|- A for some A > 0 

2. (Bounded jumps). (W ^ am) ^ am/n, for some a > 1. 

Then, for every starting state x £ LI, it holds that 

7T) 

E. [r] ^ 2a- 
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Idea of the proof. From Hypothesis 1 it follows that Zt = Ft — At is a submartingale that satisfies 
the hypotheses of the Doob’s Optional Stopping Theorem [13] (see e.g. Corollary 17.8 in [20] or 
Theorem 10.10 in [2B]), thus 

0 ^ /(x) = Ea: [Zq] ^ [Zr] = [Tt-] - AEj; [r] 


And from Hypothesis 2 it follows that E^; [F^] ^ 2am. □ 

We now exploit the above lemma in order to bound the time required by the symmetry-breaking 
stage. 

Lemma 3.3 (Symmetry-breaking stage). Let c be any configuration with j active opinions. 
Within t = O log^^^ rounds it holds that 

1 


such that ^ n/j — \/jn log ^ - 


Sketch of Proof. Let J be the set of j active opinions in c and let = {cf^ : i £ be the 
random variable indicating the opinion conhguration at round t, where we assume = c. Let 
Cm = niin i £ j| be the minimum among all C^^^^s and consider the stochastic process 

{Yt}t dehned as F) = [n/j] — Cm • Observe that Yt takes values in {0,1,... , [n/jj} and it is a 
function of We are interested in the first time F) becomes at least as large as ^/JnTogn, 

i.e. 

r = inf |t £ N : F* ^ y^jnlognj 

We now show that {Yt}t satisfies Hypotheses 1 and 2 of Lemma 13.21 with A = for a 

suitable constant e > 0. 

1. Let c = (cj : z £ J) be any conhguration with j active opinions such that Cm > njj — 
yjjnlogn. We want to prove that 

y/n 


E 


ch+i) I cW = 


^ Cm C' 


,• 3/2 


(3) 


Two cases may arise. 

Case Cm > n/j — 2e^nlj\ Observe that, in this case, r.v.s : z £ j| conditional on 

{C^*^ = c} have standard deviation Ll (^\/n/. Moreover, they are binomial and negatively 
associated. Hence, by choosing e small enough, from the Central Limit Theorem we have that 


P ( z £ J exists such that ^ — 6e 


^ 1/2 


We thus get 


E 


C^l+P I = 




1 / n 


— 6e 


n\ In n „ 

H— ‘ — = 3s 

3J 2 j j 


^ Cm £ 


^ < c —(4) 

^ ^.-3/2 


Case Cm ^ n/j — 2e-\fnfj-. Equation ([3]) easily follows from Lemma [TTI Indeed, let z £ J be 


an 


opinion such that Cj = Cm, then 


E 


C(i+i) I cW = 


^ E 

< Ci I 1 - 


^h+i) I cW = c 
2e \ 


Y' Ci 


Ci 1 

1 _l-- 

n J 


V^J 


I ^ Q .0/0 - 


n 


7-3/2 


,■ 3/2 


(5) 
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where we used the case’s condition and the fact that Q = Cm ^ ^/(2i). 

2. Since random variables : i € j| conditional on the configuration at round t are 

binomial, it is possible to apply Chernoff bound (though with some care) to prove that 

Pc (Yt ^ ay/jnlognj ^ for some constant a > 1 (6) 

Though this result seems intuitive, its formal proof is less obvious, since r is a stopping time 
and thus itself a random variable. Lemma iB.ll in Add endix IBI offers a formal proof of the above 
statement. 

From (l3|) and ([6]), we have that {Yt}t satisfies the hypotheses of Lemma [3.21 with m = y/jn log n 
and A = Sy/nj . Hence Ec [r] < j^y^logn and, from Markov inequality, for t = 2j^-^log n, 
we hnally get 

Pc (^V z G J : ^ n/j - y/jnlog ^ Pc (^r > 2 fy/\og^ ^ ^ 

□ 

We now provide the analysis of the dropping stage: More precisely, we show that, if the system 
starts with up to j active opinions and one of them (say i) is below the threshold n/j — y/jnlogn, 
then i drops to the smaller threshold j^logn within 0{j\ogn) additional rounds. This bound 
can be proved w.h.p. since, in this regime, Ci is still sufficiently large to apply the Chernoff 
bound. This concentration result is not necessary to the purpose of proving Theorem 13.11 while 
it is a key ingredient in the analysis of the adversarial case (Theorem 14.2p . The next lemma 
can be proved by standard concentration arguments - applied in an iterative way - on the r.v. 
Cf'’ (see Appendix iB]) . 

Lemma 3.4 (Dropping stage 1). Let c be any configuration with j ^ opinions, 

where e > 0 is an arbitrarily-small positive constant, and such that an opinion i exists with 
Ci ^ n/j — y/jnlog n. Within t = 0{j logn) rounds opinion i becomes O (j^ logn) w.h.p. 


In the next lemma we prove that once Cj becomes smaller than n/ (2j), then opinion i disappears 
within further O(j’logn) rounds with constant probability. We here give only an idea of the 
proof, the full proof is in Appendix iBl 

Lemma 3.5 (Dropping stage 2). Let c be any configuration with j ^ active opinions, 

where e > 0 is an arbitrarily-small positive constant, and such that an opinion i exists with 
Ci ^ n/{2j). Within t = 0{jlogn) rounds opinion i disappears with probability at least 1/2. 

Idea of the proof. If Ci ^ n/{2j) in configuration c, then from Lemma l2.II it follows that 


E 


^h+i) I ^{t) ^ ^ 



Moreover, since conditional on = c} is binomial, if j ^ from the Chernoff 

bound it follows that P > n/{2j) \ ^ g- 0 (n^)_ jjgj^ce, it is easy to check that 

for any initial configuration c with Ci ^ n/{2j) the following recursive relation holds 


r 




w 


^(1 2j.'Ec 


C} 


(t-l) 


-r>A2 


E, 


















that for some t = 0{j logn) gives Ec 


C' 


w 


^1/2. Since 


it) 


r.v., the thesis then follows from the Markov inequality. 


is a non-negative integer-valued 

□ 


Proof of Theorem 13.11 From Lemmas 13 . 3113.41 and 13.51 it follows that from any configuration 
with j ^ k active opinions, within 0{k'^y/log n + A; logn) rounds at least one of the opinions 
disappears with probability at least 1/4. Thus, within 0{{k‘^ Vlog n + k log n)(A;-|-log n)) rounds, 
all opinions but one disappear w.h.p. □ 


4 Convergence Time of 3-Majority with Adversary 

In this section we consider the presence of a Byzantine adversary that can adaptively change 
the opinion of a bounded number of nodes in order to delay convergence time toward a valid 
consensus, or even worse, to let the system converge toward a non valid one. We consider two 
different adversarial strategies: A static one and a stronger, dynamic one. 

4.1 The F-static adversary 

At the end of the first round, once every node has fixed his own initial opinion, the adversary 
looks at the configuration and arbitrarily replaces the opinion of at most F = n/k — y/kn logn 
nodes with an arbitrary opinion in S. Then the protocol starts the process and no further 
adversary’s actions are allowed. Since any opinion the adversary may introduce has size less 
than njk — y/kn log n, as a simple consequence of the dropping stage (see Lemmas 13.41 and l3.5p . 
the static adversarial case easily reduces to the non-adversarial one. We thus get the following 

Corollary 4.1. Let k ^ n°‘ for some constant a < 1 and F = n/k — y/kn logn. Starting 
from any initial configuration having k opinions, the 3-majority protocol reaches a stabilizing 
almost-consensus in presence of any F-static adversary within O {if^y/fogn -\- k log n) (A:-|-log n) 
rounds, w.h.p. 

4.2 The F-dynamic adversary 

The actions of this adversary over the studied process can be described as follows. At the end 
of every round t, after nodes have updated their opinions (i.e. once the configuration 
is realized), the F-dynamic adversary looks at the current opinion configuration and replaces 
the opinion of up to F nodes with any opinion in S. 

In what follows we consider an F-dynamic adversary with F ^ j3y/n/{k^ logn) for a suitable 
positive constant /3. As we will show in the proof of Lemma IC.71 this bound on F turns out to 
be almost tight for guaranteeing that the process converges to an almost-consensus regime in 
polynomial time, w.h.p. 

The presence of the adversary requires us to distinguish between valid and non valid opinions. 
So, we recall that the set of valid opinions C C S is the subset of active opinions in the initial 
configuration and we observe that, in the reminder of this section, k denotes the number of 
valid opinions, i.e., k := \C\. 

We are now ready to state our main result in the presence of the dynamic adversary (its full 
proof is given in Appendix [UJ . 

Theorem 4.2 (The Dynamic-Adversary Case.). Let k ^ for some constant a < 1 and 

F = l3^/n/{k'2 logn) for some constant /3 > 0. Starting from any initial configuration having 
k opinions, the 3-majority reaches a (valid) stabilizing almost-consensus in presence of any 
F-dynamic adversary within 0((A:^yTog7i-|-A:logn)(A:-|-logn)) rounds, w.h.p. 
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Idea of the Proof. We here provide a description of the main technical differences w.r.t. the 
analysis for the non-adversarial case. 

As discussed in the overview of the process analysis, the adversary can introduce “small” non- 
valid opinions and it can keep small valid opinions active that would otherwise disappear (as 
shown in Section [3l). These facts lead us to the problem of managing “small” opinions: The 
rigorous definition of small opinion is determined by the minimal negative drift for Cm we 
derived in the proof of Lemma 13.31 (see Q). 

Let 5 := {z I Cj ^ be the set of small opinions for some constant 7 > /3, and let its 

complement B := S = {i \ Ci > be the set of big opinions. 

It turns out that we cannot use the definition of the (end of) phase adopted in the non-adversarial 
case: At least one (valid) opinion dies. Wlog, let us assume that, at the beginning, all the k valid 
opinions are big. Then the new phase j is an interval of consecutive rounds, in each of which 
exactly j big valid opinions are present. The new goal is to show that at the end of phase j, one 
of the j big colors will get small and, moreover, this color (and no other small color) will never 
get big. In the symmetry-breaking stage of each phase, we thus need to show that the negative 
drift of Cm (notice that the latter now denotes the minimum among the j big colors) cannot 
be opposed by the actions of the F-dynamic adversary, provided that F ^ I3y/n/{k^ logn). 
This fact (stated in Lemma IC.7p is obtained via two different technical steps: i) A new bound 
on the expected negative drift for Cm that considers both the presence of small good opinions 
and the adversary’s opposing action (this result is formalized in Lemma IC.3p : ii) A novel use 
of Lemma 13.21 on the hitting time of random processes in order to bound the expect time of 
the symmetry-breaking stage. We in fact need to define a new stopping condition that also 
includes some “bad” event: Some small (valid or not) color become big. We then show that bad 
stopping events never happen along the entire process, w.h.p. (this is essentially guaranteed by 
Lemma IC.4p . 

The dropping stage of phase j is now defined as the interval of rounds in which Cm dro^s 
from the symmetry-breaking threshold re/j — y/jn log n to the size of small colors i.e. ^\fnlk^. 
Similarly to the non-adversary case, we can here hx the big opinion i that is dropped below 
the symmetry-breaking threshold and look at its negative drift derived from Lemma IC.31 The 
drift is strong enough to tolerate the the actions of the F-bounded adversary and implies an 
0{j logn) bound on the time required by this second stage of phase j. This stage’s analysis is 
given in Lemma IC.81 

Finally, after k phases, we are left with one (valid) opinion that accounts for n — 0{y/n) nodes, 
while the remaining nodes can have any (possibly non valid) opinion and reflect the presence 
of the adversary. In fact, this is what happens with high probability. 

□ 


5 Future Works 

We strongly believe that our upper bound on the convergence time of the 3-majority dynamics 
is not tight w.r.t. k. The factor Il(k^) seems to be not necessary: We believe that at least 
a factor k can be saved. To this aim, we would need to show that “more” opinions get small 
during a phase. This number should also depend on the current number of big colors. Another 
idea would be that of (also) considering the growth of the maximal opinion. Unfortunately, 
differently from the minimal opinion (see ([2]) in Section [2]), we don’t have any good bound on 
the expected drift for the maximal opinion that holds from any configuration. So, we don’t see 
how to efficiently adapt our approach without this crucial ingredient. 
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A Preliminary Results 


Proof of Lemma 12.11 According to the 3-majority protocol, a node u gets opinion i if it 
chooses 3 times opinion i, or if it chooses two times i and one time a different opinion, or if 
it chooses the first time opinion i and then, the second and third time, two different distinct 
opinions. Hence, if we denote by the indicator random variable of the event “Node u gets 
opinion i at time t”, we have that 

p(x.r-|C«=c) . 

= (^) + 

\ las / 

Then the inequality in ([T|) is obtained by observing that the sum minimized for 

Ci = n/\S\. 

□ 

Proof of Lemma 13.21 Consider the stochastic process Zt = Yt — \t and observe that for any 
state X € H with /(x) ^ m — 1 it holds that 

Y.[Zt+i\Xt = x] = E [Ti+i I At = x] - A(t + 1) 

^ /(^) + ~ + 1) 

^ f{x) - \t 

where in the inequality we used Hypotheses 1. Thus Zt is a submartingale up to the stopping 
time r, i.e. E [Zt+i \ Xt] ^ Zt for any t < t. Moreover, since iTjl ^ n the jumps of Zt can be 
bounded by a value independent of t 



Zt+i — Zt\ — |Tt+i — X{t -|- 1) — yj -|- At| ^ n + A 


and it is easy to see that Hypotheses 1 implies E^, [r] < oo, thus we can apply Doob’s Optional 
Stopping Theorem [13] (see also, e.g.. Corollary 17.8 in m and Theorem 10.10 in [26] 1. It then 
follows that Ej, [Zj-j ^ Ea; [Zo] = /(x) and, since E^, [Zr] = E^, [y.] - AE^, [r], we have that 

„ , , ^ E. |y;| - f(x) ^ E. [YA 
EUt|«-^ 

Finally, we get 


Eo [Hr] 


n 

= Y.3Yo{Yr=j) 

1=1 

\am\ n 

= Y.3^0{Yr=j)+ •?'Po(Er 

1=1 j=lamj+l 

^ (am) + nPo (Hr > otm) ^ 2 (am) 


j) 


where in the last inequality we used Hypothesis 2. 


□ 


13 













B Proofs for the Non-Adversarial Case 


Proof of Lemma 13.41 We first prove that the decreasing rate of Cj depends on its value at the 
end of the previous round. More formally, if we are in a configuration satisfying the hypotheses 
of the lemma: 


P 


2\j n 


= P 


1 c, 


(i-l)' 


/ [j 'n 


(1 + 5) , 


(t-1) (t-1) 

where <5 = i(i — - -)/l — (i — ^ -) 

2^j n 'I n ' 

Using Lemma l2.II and applying Chernoff bound we have: 


p +>4'-' 1+ 1 ' 


(t-1)' 


n 


i. «p -j 1- 


1 c, 


(t-1)' 


+-1) 


n 


= exp 


5/1/1 c! 
3 12 ij 


(t-1)' 




n 


< exp < — 


1/1/1 c} 


(t-1)' 




3 \ 2 I j 


n 


= n-®«. 


(7) 


The second equality in ([7]) follows from the definition of 5, while the third inequality follows by 
(upper) bounding the denominator of 5 by 1, which is always possible since Cj/n — 1/j < 0 from 
the hypotheses. Finally, to prove the last equality, we used the fact that c* ^ logn and that 
the function x (1 — x)^ is decreasing iff x € (1/3,1), with x = jci/n. 

Finally, we can iteratively apply d?]) as long as we have at most j active opinions and cf'^ 
keeps not smaller than j^logn. By standard concentration arguments we get that the time to 
reach this threshold is O {j logn), w.h.p. □ 


Proof of Lemma 13.51 Let J be the set of active opinions. By conditioning on all the configu¬ 
rations c = (q : £ € j) that the system can take at round f — 1, we can bound the expectation 
of cf^ as follows 


E. 


a 


(i) 


E \cf^ I = cl Pc = c 


^ 1 - 


h) E Q-Pc(c(* '^=b)+n- J] Pc(c(*i)=c 


2j 


c:ci^n/{2j) 


c:ci>n/(2j) 




a 


(i-l) 


n 


+ n.Pc(Cr >- 


where we used that, for any configuration c with q ^ n/(2j). Lemma 12.11 Efives the bound 


E 

that 


I Q{t 1) — £ ^ Moreover, if j ^ n^+ from Chernoff bound it follows 






















for any such configuration c. Hence, for any t we have that Pc ^ te Indeed, 


I > Yj 


^ Pc(3t = l,...,t : 


^ V Pc (c® > — A cf ^ — 

^ V * 2j * ^2j 

t 


E E p d'>>^icM = c p„(c«- 

t=l c:ci^n/{2j) 


-1) = £ 


Thus for any t = poly(n) the following recursive relation holds 


Ec 


And it gives 




Ec 


W 


^(1 2j'Ec 


C} 


(t-i) 


-r,A2 


C) 


w 


' 2jJ 2j 

(t) 


Hence, for t = 2j(logn + 1) we have that Ec Cf’ ^1/2 and since cf^ takes non-negative 
integer values, the thesis follows from Markov inequality. □ 

Lemma B.l. Let c be any configuration with j active opinions. Consider the stochastic process 
{Yt}t defined asYt= j —Cm and define the stopping time r = inf {f S N : It ^ y/ jnlogn}. 
Then: ^ 

Pc {Yt > a^J jnlog ^ 

Proof. First of all, Ec [r] < oo, since Cm has a negative drift (see the proof of Lemma [331) • 
Next, from the definition of Yp. 


Pc fPr > ay/jnlog n) = Pc ( C,^^ < 


n 


— ay/ jnlog 


n 


= Pc ( < 


« EPdC’< 

i=l 


n 

J. 

n 
3 _ 


— ay/ jn\ogn 

— ay/ jnlog 


n 


Next, from the definition of the stopping time r: 


Pc ( cf) < 


n 

LiJ 


- a\/jnIogn j = ^Pc ( Cf < y - a^/judogn/y t = t j = 


^ Pc ( Cj* < - - ay/jnlogn l\C/f 

t=i \ 

•PcfAc'^^> 




13 } 


- y/jnlog n 


t-1 


> 

S=1 


LJ J 


- y/jnlogn 


EPc Ci‘< 
t=i V 

•Pc fAc'(^^> 


n 

LJ J 

n 


- y/jnlogn = 


13 ] 

n 

LJ J 


— ay/ jnlogn 


t-i 


/\cw> 

S = 1 


LJ J 


- y/jnlogn 


- y/jnlogn 


( 8 ) 
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where the last equality follows since (cf < j “ ay/jn log n j implies (Cm < J “ y/jnlogn 


We next consider Pc (^As=i C'm > 1^jJ — y/Jnlogn^. We can write: 


Pc f A > 


\s^l 


IIPc > 

n 

J. 

— yJ jnlogn 


t-1 / 




n Pc > 

S = 1 V 

n 

J. 

— y/ jnlogn 



- 'Jjn log 1 


- Vjn log 1 


where the last equality follows since the 3-majority process is Markovian. We next give an 


upper bound on Pc ( Cm^ > 

Pc(C^)> " 


— y/jn log n 




— y/jnlogn : 


- \/jnlogn 




> 


- Vjnlogn = 


c:c,„>[ jJ -VJnTogr 


^ E 

c:c„>[jJ -Vjnlogr 


> 

n 

J. 

- y/ jnlogn^ 

> 

n 

- y/ jnlogn^ 


m 


> 


IJ i 


- y/jnlogn ^ 


. ^ 


- y/ jn log n , 


where I = arg Cm (ties broken arbitrarily). We can give an upper bound on Pc ( > t — Vin log n ) 

using a “reverse” Chernoff bouncfl. In particular, it is possible to show that 


. (c,'" > (1 - «)E4 s: 1 - ^-'’'■’=•1'="’] 

( 1 ) 


for a suitable constant /3. We use 6 = y/jnlogn/E. 
n/j, so that 


C 


and note that n/2j ^ 


c 


( 1 ) 




Pc (cA > (1 - 5)Ec 
Saturating with respect to c yields 


c 


( 1 ) 


^ 1 — e 


-4/3j2 log n 


(9) 


Pc > 


- Y/jnlogn 




> 


n 


— yjjnlogn ) ^ 1 — e 


On the other hand, using standard concentration techniques and recalling that Eg 
n/2j, we can prove that: 


C, 


( 1 ) 




Pc I C<‘ < 


n 


— ay/jnlogn 


t-i 




S=1 


— y/jnlogn ) ^ e e 


( 10 ) 


Next, substituting ([9|) and (fTOll into ([8|), the result follows after simple calculations and by 
suitably choosing a. □ 


folklore example with complete proofs can be found at http: //cstheory. stackexchange. com/questions/14471/reverse-ch( 
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C Convergence Time of 3-Majority with Adversary 


In this section we give the formal definitions of the notions introduced in Section 14.21 and we 
provide the proof of the lemmas stated in the proof outline of Theorem 14.21 

The actions of the dynamic adversary over the studied process can be formalized as follows. 

Definition C.l. At the end of every round t, after nodes have updated their opinions (i.e. 
once the configuration is realized), the F-dynamic adversary looks at the current 

opinion configuration and replaces the opinion of up to F nodes with any opinion in S. We 
define as the configuration that results from the adversary’s action on and = 
^W ) ■ ■ ■) ) as the r.v. corresponding to the number of nodes that the 

adversary adds or removes from Ci (note that \D-\ ^ 2F) at the end of the t-th round, 

based on all the past history of the process, i.e. 

We consider an T-dynamic adversary with F ^ fi^fnlik^ logn) for a suitable positive con¬ 
stant /3. As we will show in the proof of Lemma IC.71 this bound on F turns out to be almost 
tight for guaranteeing that the process converges to an almost-consensus regime in polynomial 
time, w.h.p. 

The presence of the adversary requires us to distinguish between valid and non valid opinions. 
So, we recall that the set of valid opinions C C S is the subset of active opinions in the initial 
configuration and we observe that, in the reminder of this section, k denotes the number of valid 
opinions, i.e., k := \C\. As discussed in the overview of the process analysis (Section [ 2 ]), the 
adversary can introduce “small” non-valid opinions and it can keep active small valid opinions 
that would otherwise disappear (as shown in Section [3]). These facts lead us to the problem of 
managing “small” opinions, whose formal definition can be given as follows. 

Definition C.2. Let S' := {i Cj ^ 'yy/n/k^'^ be the set of the small opinions, where 7 is some 

constant such that 7 > /3, and let its complement B := S = {i \ Ci > jy/nfk^} be the set of the 
big opinions. 

We now re-state Theorem 14.21 whose idea of proof is outlined in Section 14.21 

Theorem 14.21 Let k ^ n'^ for some constant a < 1 and F = (5y/n/{k^ logn) for some 
constant /3 > 0. Starting from any initial configuration having k opinions, the 3-majority 
reaches a (valid) stabilizing almost-consensus in presence of any F-dynamic adversary within 
0{{k'^y/logn -|- klogn){k -\- logn)) rounds, w.h.p. 

Sketch of proof. From Lemmas IC.7I and IC. 8 I it follows that from any configuration with j ^ k 
active opinions, within 0{k‘^y/logn -\- A:logn) rounds at least one of the opinions becomes small 
with probability at least 1/2. Thus within 0{{k‘^y/logn-\-k\ogn){k-\-\ogn)) rounds all opinions 
but one become small w.h.p. □ 


In order to prove Lemma IC . 71 and Lemma lC.81 we need the following three lemmas. 
Lemma C.3. Let c be any configuration such that \B\ ^ j and ^ ^yfnjk^. For some 

3 

constant a > 0, for any opinion i such that Ci ^ ’-yy/n/k^, it holds 


E 


E 



CW = c 

V/ 


CW = c 

V/ 


^ _ 1 Cj -\- ay/n(k 


n 


1 Ci -\- ay/n/k 


n 



( 11 ) 

( 12 ) 
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Proof. Similarly to the proof of Lemma 12.11 we have 

o 2 \ 


E 
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(4+1) 


cW = 


< 5.11 + - - « fi + ^ - 


n 




Ci 

1 + -- 
n 
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j&B 
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3 \ 2 \ 

n—{k—j+l)')^/n/k'^ \ 




^ Cj 1 H- 


Ci Y.j&Bin-cx/^\/n/kf 


n 


pTT? 


/ - E , Q 1 ^ a/2.Jn/k\ , nj f - Ci - aj^^Jufk 

^ Q 1 1 + , + , 1 ^ Q I 1 

\ n j 


jn 


Taking into account any possible action of the adversary, we thus get that 


n 


E 


a 


(4+1) 


= 


= E 


a 


(4+1) 


= 


+ E 


D, 


( 4 + 1 ) 


= 


/ n/j — Ci — a/2\/n/k\ „ 

^ c,; I 1 - ^ ^ ' + F 


n 


njj -Ci 

^ Ci \ 1 -h 


^a/2^/n/k, En/cj| 


n 


n 


(13) 


By distinguishing the cases c, ^ n/{3j) or c, < n/{3j), from (fTBI) we get (fT^ . □ 

In Lemma 1C.41 we prove the following key-properties of the process in the presence of the 
dynamic adversary: w.h.p., it is never the case that 

1. if in a given round a valid opinion is small then it gets big at a later time, i.e. C ; 

3 

2 . the size of the overall set of non valid opinions grows beyond ^y/n/k^, i.e. Eiec'^* ^ 

3 

^y/n/k^. 

Lemma C.4. If is such that ^ l\/n/ki, then ^ ^y/nfkh and 

5 '( 4 ) c w.h.p. 

Proof. From Lemma IC.31 for each i G we have that 


E 


a 


( 4 + 1 ) 


= 


. Ci 1 

< Q ( 1 + - - - 
n k 


From a direct application of the Chernoff bound to , and taking into account any possible 

action of the adversary, we thus get that w.h.p. 


c<‘«) = C.“«' + L‘"‘' < 7f (i - T) + F < jf, 


that is, i G w.h.p. Analogously, we have 


E 


E G 

ieC^'^'i 


(4+1) 


cw = 


ET(' + 

i&C 




n 2k J ^ 
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and then, by applying the Chernoff bound, we get that w.h.p. 


E 

iecM 


E cr‘> + E«E“’ 

ieCM i 




^ Jn 
+ F ^ 7^, 
fc2 


concluding the proof. □ 

3 

Lemma C.5. Let c he any configuration such that \B\ = j and ^ . Consider 

the stochastic process {Yt}t defined as Yt = |^jJ — and define the stopping time 

T = inf{t £ N : Li ^ y^jnlogn V (^ Ci ^ '^^/n/k^) V ^ 

iec 


Then, it holds that 

Pc (Yr > ai/jnlog^ 

Sketch of proof. The proof of this Lemma follows from minor modifications of the proof of 
Lemma iB.ll In particular, the argument is based on the following observations: 

1. The event defining the stopping time r is in this case 

= {Yt ^ {^/jnlogn) V ^ yVn/fci) V 

i&C 


The negated of this event is 

= {Yt ^ (v^jnlogn) A (^ (5i ^ ^y/n/k^ A C 

iec 


which implies the event [Yt ^ ^/jn log nj. 

2. Proceeding like in the proof of Lemma lB.il we can write an expression that is similar to dS]), 
with the generic conditioning event 



V^^ndo^, 


replaced by The conditioned event 



< 



- ay/jnlogn, 


is instead replaced by the event 



< 



- ay/jn\og 


n 


A<fW. 


Now, note that the event 


< 


n 


- aYjnAo^, 


again implies Hence, we can still write ([S]), from which the proof requires some non-hard 
adaptations w.r.t. the case without adversary. □ 
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Since the adversary, at time t, may decide what to do based on the full history of the process 

may not be a Markov process anymore. Thus, we 


up to time t, the stochastic process 
need a more general version of Lemma 13.21 


{CC)}_ 


Lemma C.6. Let {Xt}t be a discrete time stochastic process with a finite state space n, let 
ft '■ Lfi ^ N he a function mapping histories of the process in non-negative integer numbers, 
and let {Yt}t be the stochastic process over N defined by Yt = ft{Xo,... ,Xt). Let m £ N be a 
“target value”, let AQLl he an arbirary subset of states, and let 


T = inf{t G N : Yt m or Xf ^ A} 

be the random variable indicating the first time Xt exits from set A or Yt reaches or exceeds 
value m. Assume that, for every sequence of states xq, ... ,xt £ A with ft{xo, ..., xt) ^ m — 1, 
it holds that 


1. (Positive drift). E [Tj+i | Xq = xq, ..., Xt = xt] ft{xo ,..., xt) + A for some A > 0 

2. (Bounded jumps). (Yr am) ^ amjn, for some a > 1. 

Then, for every starting state x £ A, it holds that 

771 

E,, [r]<2a- 

Proof. The proof is a straight adaptation of the proof of Lemma 13.21 in which we take into 
account the full history of the process. 

Consider the stochastic process Zt = Yt — Xt. For any sequence of states xq, ... ,xt £ A with 
/t(xo,..., Xt) ^ m — 1 it holds that 

E [Zt+i \ Xq = xq, ..., Xt = Xt] = E [Lt+i \ Xq = xo,..., Xt = Xt] — X{t + 1) 

^ ftixo,... ,xt) + X-X{t + 1) 

^ ft{xo,... ,xt) - Xt 


where in the inequality we used Hypotheses 1. Thus, Zt is a submartingale up to the stopping 
time r. Moreover, since |Lt| ^ n then \Zt+i — Zt\ ^ n + A and, together with Hypotheses 1 
this implies E^, [r] < oo. Thus, we can apply Doob’s Optional Stopping Theorem [13]. It follows 
that Tjx [Zt] Tjx [Zq] = /o(x) and, since E^, [Zfi = E^, \Yt] — AE^, [r], we have that 

„ , E, [r,] - Mx) ^ E, [Yr] 

E.[t1<-^ 

Finally, we get 

[amj n 

Eo [Yr] = (Er = j) + -^^0 {Yr = j) ^ {am) + nPo (Hr > am) ^ 2 {am) 

j=l j=lamj + l 


where in the last inequality we used Hypothesis 2. □ 

Now, we can exploit Lemma 1C.61 to bound the time required by the symmetry-breaking 
stage: We show that, from any configuration with j big opinions that satisfies condition TL, 
within O log^'^^ rounds there exists a opinion supported by at most n/j — y/jn log n 
nodes with probability at least 1/2. 
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Lemma C.7 (Symmetry-breaking stage). Let c be any configuration such that \B\ = j and 
Eiec^i ^ ^y/n/k‘ 2 . Within t = O rounds, with probability at least 1/2 it holds 

that 

\B\=j, E Ci ^ '^y/n/k^^ and 3z G such that cf^ ^ n/j — y^jnlogn 
iec 

Proof. We proceeds by adapting the proof of Lemma [331 Let = c be the initial configura¬ 
tion. Let us consider the stochastic process defined as 


Yt = 




where : i G We are interested in the time step 

r = inf{t G N : 1) ^ {-\/jnlogn) V (^ ^ 'yy/n/k^) V ^ 

iec 


Now we show that {Yt}t satisfies the Hypotheses 1 and 2 of Lemma 1331 with ^ = (^ 
'yy/n/k^) V C 5^*)) and A = eyfnjf'^l'^ , for a suitable constant e > a. 

1. Let c be any configuration such that c^> nj j — yjjnlogn. Now we prove that 


E 


C-h+i) I cW = c 



(14) 


Case Cm > nf j — 2ey/nlj‘. Observe that, in this case, random variables i G H} have 

standard deviation is Q{y/n/j). Moreover they are binomial and negatively associated. Hence, 
by choosing e small enough, from the Central Limit Theorem we have that 


We thus get 


E 


P { i £ B exists such that ^ — 6 e • 


1 f n 


1/2 


(jit+i) I cW = 


- , ln\ In 0\/n 

^ +2-7 + /J^ 

J / ^ J K 2 log n 


2 \j 

n 

= - -2e 


0y/n 


J /c 2 logn 


^ dsn ^ 


„n 

^ ^ .- 3/2 


(15) 


Case Cm ^ n/j — 2ey/njj\ Equation (113) easily follows from Lemma fC.31 Indeed, let i G H be 


a opinion such that q = Cm, then 


E 


^(t+i) I Q(t) ^ 


^ E 


^(*+1) I Q(i) — 


^ Ci 


^ C,; 1 - 


2 e 


= + 


a 


A 


^ Ci+ a-sjnjk 1 
y/n 


n 


. - ey/n _ . 

^ Ci , — Cm C 


; 3/2 


1-3/2 


y/nj y/knj J 

where we used the case’s condition and Ci = nj{2j). 

2. Since random variables : i G are binomial conditional on the configuration at 

round t — 1, from the Chernoff bound it follows that 

1 
n 


(Vr ^ ay/jnlogn'j ^ , for some constant a > 1 


(16) 
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See Lemma IC.51 for the formal statement of the last fact. 

From (HID and (I16p we have that {Yt}t satisfies the hypotheses of Lemma IC.6I with m = 
y/jnlogn, A = and A = ^ V C Moreover, 

by iteratively applying Lemma IC.41 we have that, for any t = 0{'n?), it holds w.h.p. that 

^ 7 -\/n/A;^) V C S'W). Thus, from Markov’s inequality, for t = 2j^Vlogn, 

we have that 


G B, ^ n/j - Vjnlogn) A (^ -i^jkh) A (5^°) C 5^)) 

ieC 

^Pc{t ^ 2/v^log ^ ^ 


where f = inf{t G N : ^ \/jn log n}. 


□ 


Once the smallest opinion goes below the average size of the big opinions by a certain small 
amount, we can prove that the process push it in the set of small opinions w.h.p. 

Lemma C .8 (Dropping stage). Assume that, at round t', is such that ^ '')^fnjk'^, 

= j, and an i ^ ^ exists such that ''yy/n/k ‘2 ^ cf ^ ^ n/j — y/kn logn. Then, w.h.p., a 

round t" = t' + 0{k logn) exists such that ^ ^ ^yfnjkh, i G and ^ j — 1 . 

Proof. By iteratively applying Lemma fC.41 we have that, w.h.p., for each t G {t ',..., t" — 1} it 
holds ^ '^y/n/k^ and i G 

To prove that ^ j — 1, we hrst prove that, for each round t G {t' + 1,... , t"}, w.h.p. 

decreases by a certain extent that depends on cf regardless of what the adversary does. 
Let if = (1/i — (cf + ay/rijk)/n) If we are in a configuration satisfying the hypotheses 
of the lemma, we have 

P (c? > cf-') (^1 - = P (cf^ > cf-') (1 - if {I + ,5))) , 

where 6 = ^if/{l — if). Thus, using Lemma I C. 3 1 and applying the Chernoff bound we have 
P > cf~^^ (^1 - ^ exp < exp |-^ Qv’) (17) 


where the second inequality follows from the definition of 6 and the fact that its denominator 
is smaller than 1, and the equality in (1171) follows by minimizing if'^cf for 'yy/n/k^ ^ cf'^ ^ 
n/j — y/kn logn. 

It follows that, w.h.p. 



d*) + D, 


(t) 




+ F^ 


ft-i) 


(18) 


Thus, w.h.p., we can iteratively apply (fT8|) until cf ^ 'jy/n/k^. We next prove that 
this happens within O {klogn) rounds, w.h.p. Interestingly, showing that, within O (A:logn) 
rounds, Ci decreases to a costant fraction of its value at the beginning of the dropping stage 
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does not seem obvious. For this reason, we consider the evolution of the displacement j — Ci, 
which seems analytically more tractable. To this purpose, note that (11711 implies that, w.h.p. 


n 




n 




cf [ I cf + a^Jnjk 


(i-i) 


2 U' 


n 


(t-i) (. (t-i)' 

^ _ (i-i) , __ f 1 _ __ 

.7 * 2 .7 n 


1 - 


a 




„ , , Ji-i) /i Ji-i) 

=-cr>+V 11+ 

.7 2 \ 7 n 


1 /j-cf 
a 


logn 


n u-i) \ , Cj 

- - q M 11 + «i 


h- 1 )' 


2n 


(19) 


for some constant ai > 0 , where in the first equality of (fTH]) we have used that n/j — cf ^ 
y/kn log n. 

We can now conclude the proof of Lemma 1C.81 We first prove that Ci ^ n/ {2j) within 
O (klogn) steps, w.h.p. To this purpose, note that j — c, ^ ^/k7^Ao^ at the beginning of the 
droppign stage from the hypotheses. Furthermore, for some positive constants 02 and as, as 
long as Ci ^ Oi^njj it holds 1 + aiCijn ^ 1 + a 2 /j- Hence, after O {klogn) steps, w.h.p. we 
have j —Ci ^ (1 — 03 ) j, which in turn implies Ci ^ a^nfj. Once q ^ a^njj, using again (fTOl) we 
have that Ci decreases by a factor 1 — i}{l/j) in every round w.h.p. By standard concentration 

3 

arguments we obtain that eventually c* ^ jy/n/k^ within O (klogn) more steps, w.h.p. □ 
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